Adaptive Sampling Under Low Noise Conditions

We survey some recent results on efficient margin-based algorithms for adaptive sampling in binary classification tasks. Using the so-called Mammen-Tsybakov low noise condition to parametrize the distribution of covariates, and assuming linear label noise, we state bounds on the convergence rate of the adaptive sampler to the Bayes risk. These bounds show that, excluding logarithmic factors, the average risk converges to the Bayes risk at rate N , where N denotes the number of queried labels and α is the nonnegative exponent in the low noise condition. For all α > √ 3 − 1 this convergence rate is asymptotically faster than the rate N achieved by the fully supervised version of the base adaptive sampler, which queries all labels. Moreover, for α → ∞ (hard margin condition) the gap between the semiand fully-supervised rates becomes exponential.